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© Make-up simulator. 



© A make-up simulator wherein ail necessary operations can be executed in accordance with menus on a 
display picture and various delicate graphic image processing functions essentially required for a make-up are 
incorporated. In the make-up simulator, a face of an object person is digitized as a graphic image of a high 
quality using a color TV camera and then the graphic image thus inputted is processed is various ways including 
revisions and changes and combinations of colors based on the procedure of an actual make-up and then 
outputted to a color monitor TV set and/or a color hard copy device. The make-up simulator comprises a graphic 
image memory and a graphic image memory controller for controlling the graphic image memory, and a co- 
ordinate input device such as a tablet and a pressure sensitive stylus pen for inputting co-ordinates of a working 
location and a working condition of a graphic image of a face. A graphic image processing circuit executes 
required processings of a graphic image and controls the color monitor TV set. 
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MAKE-SIMULATOR 



BACKGROUND OF THE INVENTION 

The invention relates to a device for processing a graphic image of a face of an object person with a 

5 plane paint system using a computer to simulate make-up of the object person. 

The invention provides a computer system designed for simulation of a make-up wherein a face of an 
object person is digitized as a graphic image of high quality using a color TV camera and then the graphic 
image thus inputted is processed in various ways including revisions and changes and combinations of 
colors based on the procedure of a make-up and then outputted to a color monitor TV set and/or a color 

/o hard copy device. The computer system exclusively for a make-up according to the invention is designed 
and optimized to efficiently complete such a series of operations in a possible shortest period of time using 
the up-to-date semiconductor technology. 

Conventionally, no computer system has been designed exclusively for a make-up simulator, and only a 
general purpose plane paint system is employed as a make-up simulator. 

75 However, employment of such a conventional general purpose plane paint system as a make-up 
simulator raises following problems. 

At first, the combination of ready-made hardware and software as in a conventional system involves 
various restrictions and is disadvantageous in cost and function. In particular, input of data is in most cases 
performed by way of a keyboard, which results in a low operability and is inconvenient to a user. Also as for 

20 a graphic image processing function, requirements for delicate and fine operations necessary for a make-up 
are not met, and hence satisfactory simulation cannot be attained. Further, processing is not accomplished 
at a high speed, and hence the system is not suitable for demonstration at the shop-front In addition, the 
system is large in size and high in weight and hence is inconvenient for carrying and transportation. 

25 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a make-up simulator which resolves such problems of 
conventional systems as described above. 
30 It is another object of the invention to provide a make-up simulator wherein all necessary operations can 
be executed in accordance with menus on a picture to improve the operability without particularly using a 
CRT Terminal. 

It is a further object of the invention to provide a make-up simulator wherein various delicate graphic 
image processing functions essentially required for a make-up are incorporated to improve the performance 

35 thereof to effect simulation accordance with an actual make-up. 

It is a still further object of the invention to provide a make-up simulator wherein a mass processing 
processor and/or a high density, high capacity semiconductor graphic image memory are incorporated to 
reduce the overall size and weight of the device and raise the processing speed. 

According to the present invention, there is provided a make-up simulator, comprising a color image 

40 pickup device for converting an original graphic image of a face of an object person into input video signals, 
a color display unit for reproducing worked output video signals as a worked graphic image of a face, a 
video signal input/output module connected to said color image pickup device and said color display unit 
for converting input video signals into dot data and for converting worked dot data into output video signals, 
a graphic image memory connected to said video signal input/output module by way of a dot data bus for 

45 storing dot data therein, a graphic image memory controller connected to said graphic image memory by 
way of a memory bus for controlling reading out of and writing into said graphic image memory, a co- 
ordinate input device for inputting co-ordinates of a working location and a working condition of a graphic 
image of a face, and a graphic image processing circuit coupled to said graphic image memory controller 
and said co-ordinate input device by way of a system bus for receiving dot data from said graphic image 

so memory controller in response to inputted working location co-ordinates, selectively executing a working of 
painting, brushing, chalking, washing, copying, mixing or erasing of dot data in accordance with the inputted 
working condition and then delivering dot data thus worked to said graphic image memory controller and for 
controlling indication on said display unit of a location of co-ordinates inputted from said co-ordinate input 
device. 
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The above and other objects, features and advantages of the present invention will become apparent 
rrom the following description and the appended claims, taken in conjunction with the accompanying 
drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. I is a block diagram illustrating a general construction of a make-up simulator according to the 
present invention; 

io Rg. 2 is a schematic illustration of a picture of a color monitor TV set; 

Fig. 3 is a block diagram of a video signal input/ output module; 

Fig. 4 is a block diagram of graphic image memory circuits and a graphic image memory controller 

circuit; 

Fig. 5 is a block diagram of a red memory circuit; 
'5 Fig. 6 is a block diagram of the graphic image memory controller circuit; 

Fig. 7 is a flow chart of a main loop of a control program; 

Figs. 8(A) and 8(B) are flow charts of a window specifying routine; 

Figs. 9(A) and 9(B) are flow charts of a color palette task routine; 

Figs. 10(A) and 10(B) are flow charts of a function menu task routine; 
20 Figs. 11(A) and 11(B) are flow charts of a brush size number determining task routine; 

Rg. 12 is a flow chart of a working task routine; 

Fig. 13 is a flow chart of a painting routine; 

Rg. 14 is a diagrammatic representation of a graphic image memory within a working graphic image 
window; 

25 Rg. 15 is a flow chart of a painting routing for a picture element; 

Rg. 16 is a diagrammatic representation of a graphic image memory; 

Fig. 17 is a flow chart of a brushing routine; 

Rg. 18 is a flow chart of a chalking routine; 

Rg. 19 is a flow chart of a washing routine; 
30 Rg. 20 is a flow chart of a copying routine; 

Rg. 21 is a flow chart of a mixing routine; 

Rg. 22 is a flow chart of an erasing routine; 

Fig. 23 is a flow chart of a mask producing routine; 

Rgs. 24(A) and 24(B) are schematic illustrations of a masking working; 
35 Fig. 25 is a flow chart of a color changing routine; 

Rgs. 26(A). 26(B) are 26(C) are schematic illustrations of a color changing working; 

Rgs. 27 is a flow chart of a scaling routine; 

Rgs. 28(A). 28(B) and 28<C) are schematic illustrations of a scaling working; 
Rg. 29 is a flow chart of a mirroring routine; 
40 Rgs. 30(A) and 30(B) are schematic illustrations of a mirroring working; 

Rg. 31 is a flow chart of a composing routine; and 

Rgs. 32(A), 32(B). 32(C) and 32(D) are schematic illustrations of a composing working. 



45 DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring first to Rg. I, a make-up simulator according to the present invention comprises a three-tube 
type color TV camera I as an example of an image pickup device for inputting an original graphic image of 
a face of an object person to the make-up simulator therethrough. The make-up simulator further comprises 

so a color monitor TV set 2 as a display unit for displaying thereon a graphic image of the face during or after 
working. Since the color monitor TV set 2 makes a display in a non-interlacing scanning output mode, a 
bright, non-flickering graphic image can be attained, and hence the color monitor TV set 2 is suitable for 
demonstration at the shop-front. In order to convert output signals of the TV camera into non-interlaced 
signals, the color monitor TV set 2 contains a scan converter circuit therein. The make-up simulator further 

55 comprises a color hard copy device 3 for fixing a worked graphic image to a face of a sheet of paper to be 
distributed to a customer, and a video signal input/output module 4 which in turn contains therein an analog 
to digital (A/D) converter 101 fr digitizing video signals inputted by way of the color TV camera I to form 
original dot data and a digital to analog (D/A) converter 102 for converting worked dot data into analog 
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signals to deliver output video signals to the color monitor TV set 2 or the color hard copy device 3. Details 
of the video signal input/output module 4 are illustrated in Fig. 3. In order to produce a non-interlaced 
output, the video signal input/output module 4 includes a scan converter circuit and a synchronizing signal 
generating follower circuit 103. The video signal input/output module may be physicaJly divided into an input 

5 portion and an output portion. 

Referring back to Fig. I. the make-up simulator further comprises a graphic image memory 5 connected 
to the video signal input/output module 4 by way of a dot data bus 6. The graphic image memory 5 is 
formed from 256-kilobrt semiconductor memory chips and stores therein 1024 * 2048 dot data for the three 
rod (R), green (G) and blue (B) primary colors in 256 gradations. Accordingly, the number of colors for 

io display amounts to about 16.77 millions, which enables a very delicate colored make-up. The graphic image 
memory 5 receives original dot data by way of the dot data bus 6 and develops worked dot data. Details of 
the graphic image memory 5 are illustrated in Figs. 4 and 5. Fig. 5 illustrates a red graphic image memory 
104 as an example of such graphic image memory 5. The graphic image memory 104 includes shift registers 
5 for converting parallel dot data into serial dot data and vice versa. 

75 Referring back again to Fig. I the make-up simulator further comprises a graphic image memory 
controller 7 connected to the graphic image memory 5 by way of a memory bus 8. The graphic image 
memory .controller 7 controls writing and reading of dot data into and out of the graphic image memory 5 in 
response to an address instruction from a CPU. Details of the graphic image memory controller 7 are 
illustrated in Fig. 6. In order to produce an address signal for the graphic image memory 5, the graphic 

20 image memory controller 7 includes a location resistor 106, a horizontal counter 107, a vertical counter 108 
and an address multiplexer 109. Referring back to Fig. I. the make-up simulator further comprises a tablet 9 
as an example of a co-ordinate input device, and a stylus pen 10 is used to 'input data by way of the tablet 
9. Thus, the tablet 9 acts as a device to input co-ordinate data of a working location and a working condition 
of an original graphic image and deliver an execution instruction for a make-up to the CPU using the stylus 

25 pen 10. The input is of the menu type wherein a menu is displayed on the color monitor TV set 2, and 
hence the operability is very high. Further, the stylus pen 10 is of the pressure sensitive type, which enables 
the compatibility of the make-up simulator with software for natural touch such as brushing. Co-ordinate 
data of a location of a graphic image to be worked are inputted with a location of the stylus pen 10 on the 
tablet 9, and such a location of the stylus pen 10 is simultaneously displayed aJso on the color monitor TV 

30 set 2. Accordingly, a working point can be inputted very conveniently. 

The make-up simulator further comprises a graphic image processing circuit 12 connected to the 
graphic image memory controller 7 and the tablet 9 by way of a system but II. The graphic image 
processing circuit 12 receiver dot data from the graphic image memory controller 7 in response to working 
location co-ordinate data inputted from the tablet 9, selectively executes one of workings of painting, 

35 brushing, chalking, washing, copying, mixing and erasing of dot data in response to working conditions 
inputted from the tablet 9, and delivers dot data thus worked to the graphic image memory controller 7. 
Details of such workings will be hereinafter described. The graphic image processing circuit 12 further 
controls indication of inputted co-ordinates of the tablet 9 on the display unit 2. The graphic image 
processing circuit 12 includes a 32-bit CPU processor 13 (MC68020, 16MHz), a serial controller 14 serving as 

40 an interface to the tablet 9, a floppy controller 16 serving as an interface to a 3.5 inch floppy disk drive unit 
15. a RAM 17 (256 kilobyte high speed static memory), and a ROM 18 (128 kilobyte). The ROM 18 and the 
RAM 17 store therein basic operation programs for the entire system while specific software for make-up 
simulation is stored in a floppy disk which is used on the floppy disk drive unit 15. The contents of the 
software will be hereinafter described. The CPU 13 executes control of the entire system and calculation 

45 necessary for processing of dot data. The CPU 13 is constituted as a 32-bit CPU which allows calculations 
at a high speed. 

Now, basic operations of the make-up simulator will be described with reference to Rg. 2 which 
illustrates a display picture of the color monitor TV set 2. X, Y co-ordinates on the display picture 
correspond one-to-one to X, Y co-ordinates of the tablet 9 and also to X, Y address coordinates of the 

so graphic image memory 5, and accordingly individual display areas (hereinafter referred to as windows) of 
the display picture correspond simultaneously to input areas of the tablet 9 and to storage areas of the 
graphic image memory 5. Accordingly, the words "co-ordinate" and "window" are used commonly with 
respect to the three devices. Such corresponding relationships of the co-ordinates are controlled by the 
graphic image processing circuit 12. 

55 * The windows include an original (source) graphic image window 19 which displays thereon a graphic 
image before working of a face of an object person obtained by way of the color TV camera I, a worked - 
(target) graphic image window 20 which displays thereon a graphic image during or after working and no 
which a point (dot) to be worked is specified by a stylus pen location spot 21. and a color palette window 22 



4 



0 226 959 



through which a color for coloring is specified and which includes 20 color palettes 22a in the display 
picture shown in Fig. 2. One of the color pallettes 22a is selected by the spot 21 to input the same to the 
CPU. A similar inputting method also applies to following windows. The windows further include an additive 
color amount determining window 23 including a bar graph for specifying the density to be colored, and a 

5 pen size specifying window 24 for specifying a circle of a predetermined radius in order that picture 
elements (dots) within a circle of the predetermined radius around a point of co-ordinates selected by the 
spot 21 may be worked collectively with same conditions. The circle corresponds to the size of a brush for 
an actual make-up, and the pen size specifying window 24 shown in Fig. 2 includes four such circles to 
allow selection of one of four pens which are different in size from each other. A pen having a smaller size 

io will allow a more delicate working. The windows further include a function menu window 25 for selecting a 
sort of a working therethrough. Details of various workings will be described below. 

(1) Painting 

Picture elements are daubed in a color. 

(2) Brushing 

is Picture elements are repetitively colored. This is a graphic image retouching function and is suitable to 
provide intensity in an edgewise direction or to provide shading. This is considered important also in an 
actual make-up. 

(3) Chalking 

This is called random tiling and colors a plurality of dots at random. This is necessary for making up an 
20 eyebrow or an eye. This resultantly allows spotted coloring. Or otherwise, this will result in coloring like 
pointillism. 

(4) Washing 

This corresponds to washing off of the make-up and changes the color while maintaining the brightness 
(tone) of a current color in order to restore a color of the bare skin. 
25 (5) Copying 

Part of a graphic image is transferred to another part. This is used, for example, to transplant or remove a 
mole. 

(6) Mixing 

Colors of adjacent dots are averaged to make the texture finer. 
30 (7) Erasing 

A worked graphic image is cancelled and an original graphic image is restored. 

(8) Mask Production 

A pattern of, for example, a mouth or hair is cut out from an original graphic image to produce a mask. 

(9) Color Changing 

35 The color of a graphic image within a designated mask is collectively changed into a designated color. This 
is used for co-ordination. 

(10) Scaling (Enlargement/Reduction) 

A graphic image is partially enlarged or reduced in the X or Y direction. 

(11) Mirroring 

40 A graphic image is turned left side right. This is used to produce a condition of a face reflected by a mirror. 

(12) Composing 

A mask pattern is replaced by another to facilities selection of a hair style or the like. This is used for co- 
ordination. 

In summary, at first a color palette, an additive color amount, a pen size and a function are determined 
45 by the spot 21, and then the spot 21 is moved to a desired location of a worked graphic image 20 to execute 
an intended working or make-up. Since ail necessary operations can be executed with menus on the 
display picture in this manner, the operability is high. Besides, since ail working functions required for an 
actual make-up are involved, delicate and fine simulation is available. 

Now, operation of the make-up simulator according to the present invention will be described in detail 
50 with reference to flow charts shown in the accompanying drawings. 

Fig. 7 is a flow chart of a main loop of the entire make-up simulator. Referring to Fig. 7, at first a> 
ordinates (X = HHH, Y = WV) of a point inputted by way of the tablet are read, and then it is determined to 
which window the co-ordinates belong. Here, in case a flag W = 0. the co-ordinates (X, Y) belong to the 
color palette window 22. and accordingly a color pallet task is executed to specify a color for coloring. In 
55 case W = l, the co-ordinates (X, Y) belong to the function menu window 25. and accordingly a function menu 
task is executed to specify contents of a working, ft is to be noted that in case of a working which is 
independent of any other working, the working is executed subsequently by a direct command executing 
task therefor. In case W = 2, the co-ordinates (X. Y) belong to the pen size specifying window 24, and 
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accordingly a pen size specifying task is executed to specify a desired size of a pen. In case W=3, the co- 
ordinates (X, Y) belong to the worked graphic image window 20, and accordingly a graphic image working 
task is executed in accordance with results of the three preceding tasks and an additive color amount data 
INT. Judgement of EXIT is executed after then in order to judge whether or not is necessary to repeat the 
5 main loop again. In case EXIT = I, the main loop comes to an end. 

Fig. 8(A) is a flow chart of a routine for the window specifying working of Fig. 7 in which the flag W is 
sequentially checked, and Fig. 8(B) is flow chart showing details of a step of window W = 0 judging 
operation of Fig. 8(A). 

Fig. 9(A) shows a flow chart of a color palette task executing routine. Referring to Fig. 9(A), at first 
w absolute co-ordinates (X, Y) are converted into local co-ordinates (X Ll YJ within the color platte window. 
Then, a color number CC of a corresponding color palette is selected in accordance with the locaJ co- 
ordinates (X L , YJ. A flow chart of a routine for selection of a color number CC is shown in Fig. 9(B). The 
color number CC is indicated by 

CC= + 4^ »• 

n n 
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55 



Here, n is a source size, and m is a palette number in the X direction. Fig. 10(A) is a flow chart of a function 
menu task executing routine. In the routine of Fig. I0)A), similarly to the routine of Fig. 9(A), absolute co- 
ordinates are first converted into different local co-ordinates, and then a function njmber CF indicative of a 
sort of a function is specified. Calculation for specifying CF is illustrated in Fig. 10(B). 

Fig. 11(A) is a flow chart of a pen size determining task executing routine. In the routine of Fig. 11(A), 
similarly to the routine of Fig. 9(A), absolute co-ordinates are first converted into local co-ordinates, and 
then an index BS indicative of a radius or size (brush) of a pen is specified. Calculation for specifying BS is 
illustrated in Fig. 11(B). 

Fig. 12 is a flow chart of a working task executing routine. In the routine of Fig. 12, similarly to the routine 
of Fig. 9(A), absolute co-ordinates (X. Y) are converted into local co-ordinates (X L , Y^) within the worked 
graphic image window 20. (X L , Y|_) indicate a location of a dot of a graphic image which is to be worked. 
Subsequently, in accordance with a value of the index CF specified in the function menu task, a working 
such as painting (CF = 0). brushing (CF = I) or chalking (CF = 2) is executed. 

Now, flow charts of routines for execution of such various functions (workings) from CF = 0 to CF = II will 
be described. Fig. 13 shows a flow chart of a painting routine, and the painting routine will be described in 
connection with a diagrammatic representation of Fig. 14 showing a graphic image memory within the 
working graphic image window. Before starting, parameters of the flag CF = 0. the palette color number CC - 
(corresponding to a ratio among amounts (Ro G c» B c ) of the three primary colors to be mixed), the pen 
size BS and the additive color rate INT have been determined during execution of respective preceding 
tasks. At first, a circle 26 having the radius BS is drawn around the co-ordinates (X b YJ selected in the 
worked graphic image window (refer to Fig. 14). Data of picture elements, that is, dots contained within the 
circle 26 will be hereafter processed collectively. To this end. a square 27 in which the circle 26 is inscribed 
is determined such that it has an apex at (Xc , Y c ). Beginning with the reference point thus determined by - 
(Xc. Y c ), picture elements within the square 27 are selected one by one by rester scanning. Such scanning 
is effected by incrementing X and Y counters. Thus, it is judged whether or not one after another picture 
element is contained in the circle, and where it is within the circle, painting is executed for the picture 
element When scanning within the square 27 is completed, the painting working to be executed by a single 
input by the pen is ended. Then, if the pen is moved to any other location, painting is executed from the 
beginning again. Rg. 15 shows a flow chart of a routine for executing painting of a single picture element 
The routine of Fig. 15 will be described in connection with a diagrammatic representation of Fig. 16 showing 
the graphic image memory. At first three primary color data (R s , G s . B s ) are read out from a caell within a 
source graphic image area 28 of the graphic image memory having an address of the co-ordinates (Xc, Y c ) 
of a dot to be worked. Then, three color data (Rc, G c . B c ) of a color to be colored are read out as 
parameters from a menu area 29 of the graphic image memory. Simultaneously, an additive color rate INT 
is read out Then, calculation of an equation (I) below is executed for each of the three primary colors in 
order to obtain color data (R T , Gr, Br) of the three primary colors after working. 
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20 



R S (100-INT) + R -INT 

= ' (1) 

1 100 

(while the equation (I) above provides for calculation for the red color, calculation for the two other primary 
colors is similar to this.) 

The dot color data (Rt. Gt. Bt) thus obtained are then written into cells of an address (Xc. Y c ) within a 
working (target) graphic image area 30 of the graphic image memory. Here, where the additive color rate 
INT is 100%. the dot is completely painted with the color of the designated color palette, but if the additive 
color rate INT is 50%, then the dot is painted with a color of a mixture of equal amounts of the original color 
and the color of the designated color palette. 

Fig. 17 shows a flow chart of a brushing routine. Since the brushing routine is similar to the painting 
routine, description will be given only of a difference, that is, an equation (2) in a routine for executing 
brushing of a single picture element This also applies to flow charts for other functions shown in Figs. 18 to 
22. 

Row chart of a Brushing Routine of Fig. 17 Equation (2) 

R T f (100-INT) + R C *INT 

R = 

100 



Here. R T ' is used instead of R s in the equation (I) for painting. R T ' is a color data of a worked graphic image 
before brushing.Accordingly. Rj can be renewed by repetitive brushing, and after all, this corresponds to lap 
25 painting. 

Flow chart of a Chalking Routine of Fig. 18 Equation (3) 

R r (100-INT) + R *INT 



30 




(Here. (Xc. Y c ) are selected from a table of random numbers.) The equation (3) is the same as the equation 
(I) above for painting, but here, only when the co-ordinates (Xc, Y c ) of an object dot are selected at random 
from a table of random numbers, coloring is executed. Thus, random tiling is performed. 
Flow chart of a Washing Routine of Fig. 19 Equation (4) 



R r X GL 

40 ^ 

R T = 

EE 

Provided, however, 



•45 

AA X R T ' + BB X Gj 1 + CC X B T ' 

G, 



50 



DD 



(here. AA. BB. CC. DD and EE are constants.) GL represents a brightness (tone) of a dot of the precedingly 
worked graphic image. Accordingly. GL is a white-black data, and this is multiplied by the color data Rc of 
the selected color palette in order to restore a flesh color. 
Flow Chart of a Copying Routine of Fig. 20 Equation (5) 

55 



7 



0 226 959 



R T ' (100-INT) + R p -INT 



100 

Here R P = R P (Xc + Xoff. Y c + Yoff )• Rp is a color data of a dot spaced by (Xoff . Y off) from the co- 
ordinates (Xc, Y c ) of the object dot and is moved with the fixed rate INT to the dot (Xc. Y(J. 
Row Chart of a Mixing Routine of Fig. 21 Equation (6) 



TO 



R„ = 



R T « (100-INT) 



100 



R -INT 



Here, 

»s 



R M = 

V (X C+1' Y C )+V (X C-1' Y C ) + R T '(X C/ Y C+1 ) + R T '(X C/ Y^) 

4 



R M is thus obtained by averaging color data of four dots located horizontally and vertically adjacent the 
object dot (Xc, Y c ) and adding a resulted data of such averaging with the fixed rate INT to R T ' (Xc, Y c ). As a 
result, dispersed colors are uniformed. 

Flow Chart of a Frasing Routine of Rg. 22 Equation (7) 



30 



R T ! (100-INT) 



100 



+ R -INT 



35 Now, if INT = 100%. then R T ' is completely replaced by the color R s of the original graphic image. This 
means erasing. 

By the way. the functions described hereinabove with reference to Figs. 13 to 22, that is, painting, 
brushing, chalking, washing, copying, mixing and erasing, are all basic functions for make-up simulation. 
However, in order to make the present make-up simulation more convenient, additional functions may 
40 be provided. Some examples will be listed below, but since they will be apparent from respective flowcharts 
and schematic illustrations therefor, detailed description are omitted herein. 

As to a mask producing function, a flow chart and a schematic illustration of the function are shown in 
Figs. 23 and 24, respectively. 

A color changing function will become apparent from Figs. 25 and 26. A mask pattern is colored by the 
45 function. A scaling function will be apparent from Figs. 27 and 28. 
A mirroring function is illustrated in Rgs. 29 and 30. 

A composing function is illustrated in Rgs. 31 and 32. This is suitably used for co-ordination such as 
composition of a mask. 

As apparent from the foregoing description, according to the present invention, a make-up simulator 
50 processes a graphic image of a face of an object person with functions or workings based on an actual 
make-up by means of an operating processing circuit of a high speed and a large capacity and thus outputs 
a worked graphic image. Accordingly, following effects can be attained. 

Since revision, changing of a color and composition are effected based on a procedure of a make-up, 
very accurate simulation can be attained. 
55 Since processing of a graphic image is performed at a high speed, the make-up simulator is suitable for 
demonstration at the shop-front. 

Since a non-intertaced output method is used, an output picture provides no flickering and is bright 
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.Since a large capacity graphic image memory is employed, a very large number of colors can be 
reproduced and hence a delicate color tone can be attained. 

Since a pressure sensitive stylus pen is used, the make-up simulator is compatible with software for 
natural touch such as brushing. 
5 Since all necessary operations can be done with menus on the picture without using a CRT terminal or 
the like, the operability is high. 

Since the input layout is of the multi-window type, a picture layout easy to use can be attained. 

Since the make-up simulator involves a brushing function based on a procedure of an actual make-up. it 
is suitable for a make-up. 
io The composing function and the color changing function can be utilized for co-ordination. 

Having now fully described the invention, it will be apparent to one of ordinary skill in the art that many 
changes and modifications can be made thereto without departing from the spirit and scope of the invention 
as set forth herein. 

15 

Claims 

1. A make-up simulator, comprising a color image pickup device for converting an original graphic image 
of a face of an object person into input video signals, a color display unit for reproducing worked output 

20 video signals as a worked graphic image of a face, a video signal input/output module connected to said 
color image pickup device and said color display unit for converting input video signals into dot data and for 
converting worked dot data into output video signals, a graphic image memory connected to said video 
signal input/output module by way of a dot data bus for storing dot data therein, a graphic image memory 
controller connected to said graphic image memory by way of a memory bus for controlling reading out of 

25 and writing into said graphic image memory, a co-ordinate input device for inputting co-ordinates of a 
working location and a working condition of a graphic image of a face, and a graphic image processing 
circuit coupled to said graphic image memory controller and said co-ordinate input device by way of a 
system bus for receiving dot data from said graphic image memory controller in response to inputted 
working location co-ordinates, selectively executing a working of painting, brushing, chalking, washing, 

30 copying, mixing or erasing of dot data in accordance with the inputted working condition and then delivering 
dot data thus worked to said graphic image memory controller and for controlling indication on said display 
unit of a location of co-ordinates inputted from said co-ordinate input device. 

2. A make-up simulator according to claim I, wherein said color display unit is a color monitor TV set of 
the non-interlacing type. 

35 3. A make-up simulator according to claim I, wherein said color display unit displays an original graphic 
image of a face and a worked graphic image of the face in a juxtaposed relationship thereon. 

4. A make-up simulator according to claim I, wherein said graphic image memory includes a large 
capacity semiconductor memory device. * 

5. A make-up simulator according to claim I, wherein said graphic image processing circuit includes a 
40 32-bit processor therein and executes a high speed calculating operation. 

6. A make-up simulator according to claim I. wherein said co-ordinate input device includes a tablet and 
a stylus pen of the pressure sensitive type. 

7. A make-up simulator according to claim 6. wherein said tablet is divided into a function menu window 
for inputting contents of a working therethrough, a window for specifying a size of a pen therethrough, a 

45 color pallet window for designating therethrough a color to be colored, and a window for specifying an 
amount of coloring therethrough, and said windows are displayed on said display unit. 

8. A make-up simulator according to Claim I, wherein said graphic image processing circuit additionally ' 
performs production of a mask, changing of a color and composition in response to an instruction given by 
way of said co-ordinate input device. 

50 



55 



9 



0 226 959 




0 226 959 



FIG. 2 



24 



25 



PAINT 



WASH 



ERASE 



SCALE 



23 



BRUSH 



COPY 

MASK 
PROD. 

MIRROR 



CHALK 



MIX 

COLOR 
CHANGE 

compose! 



O 
O 
O 



22 

_L_ 




0 226 959 



FIG. 3 



DOT DATA 
A 



I 



BUFFER 



DATA 
MULTIPLEXER 



102 



d/a CONVERTER 



SYNC. SIGNAL 



LEVEL 

SHIFTER 



SYNCHRONIZING 
TIMING SIGNAL 

GENERATOR 



a /dC0NVERTER 



VIDEO SIGNAL 
INPUT 



SIGNAL 

PROCESSING 

CIRCUIT 



103 



VIDEO SIGNAL 
"OUTPUT 



101 



SYSTEM BUS FIG. 4 





GRAPHIC IMAGE 

MEMORY 
CONTROLLER 









SYNC. 
° SIGNAL 



DOT DATA 
-MEMORY BUS ? 





RED GRAPHIC 
IMAGE MEMORY 








104 



GREEN GRAPHIC 
IMAGE MEMORY 



BLUE GRAPHIC 
IMAGE MEMORY 



MASK PATTERN 
MEMORY 



MEMORY BUS 

T 



FIG. 5 



DOT DATA 
o 



ADDRESS 
BUFFER 



DATA 
BUFFER 



ADDRESS 



DOT DATA 
BUFFER 



DATA 



256Kbit DYNAMIC MEMORY x 8 



02 



SHIFT REGISTER 



256 Kbit DYNAMIC MEMORY x 8 



SHIFT REGISTER 



0 3 



25 6 Kbit DYNAMIC MEMORY x 8 
, 1 



SHIFT REGISTER 



T 
I 
I 
I 
I 



1 r 

i i 



Ox , 25 6 Kbit DYNAMIC MEMORY x8 i 'SHIFT REGISTER 



07 








SHIFT REGISTER 



105 



109 



SYSTEM BUS 



FIG. 6 

SYNC. SIGNAL 



BUFFER 

INTERFACE 



TIMING 
GENERATOR 



CONTROL 
REGISTER 



i 



LOCATION 
REGISTER 



CONTROL 
CIRCUIT 



1 



ADDRESS 
MULTIPLEXER 



HORIZONTAL 
COUNTER 



■6 



DATA 
BUFFER 



VERTICAL 
COUNTER 



-1 



.106 



-107 



108 



ADDRESS 
BUFFER 



CONTROL 
SIGNAL BUFFER 



MEMORY BUS 



0 226 959 



FIG. 7 



START 



W=0 



COLOR 

PALLET 

TASK 



REAC 
TABL 
.POIN 


) 

ET 
T 






SPECI 
WIND 
W- 


FY 
OW 

X 



X S HHH 
Y = VVV 



W=2 



FUNC 
MENl 
TASH 


:tion 
J 

* 






DIREC 
COMIS 
EXECl 
TASK 


rr 

/IAND 
JTING 



PEN SIZE 
DETERMIN- 
ING TASK 




W=3 



WORKING 
TASK 



£XIT-XV^°- 



EXIT=I 



END 



0 226 959 



FIG. 8(A) 



X-HHH 
Y'WV 




FIG. 8 (B) 



START 




U 226 959 



FIG. 9(A) 



START 



w-o 

X-HHH 
Y- VVV 



COLOR FILLET 

WINDOW 

CO-ORDINATE 
CONVf 



XL - HHH-WOXS 
YL ■ VVV-WOYS 



COLOR 


NUMBER 


SELECTION 


CC = 


X 



END 



FIG. 9 (B) 





START 






y 


i 




cc= 


Xk+. 
n T 








f 



{ 



n ; PALLET SOURCE SIZE 
m; PALLET NUMBER 
(X DIRECTION) 



END 



u Z2t> y&y 



FIG. 10(A) 



END 



FIG. 10(B) 



START 






CF = 


YL 
n 






END 



n ; FUNCTION RECTANGLE SIZE 



START 




1 


FUNCTION MENU 
WINDOW 

CO-ORDINATE i 
CONVERSION 




1 


SPECIFY 

FUNcro 

cf= : 


VJNUMBEF 
< 



XL « HHH-W1XS 
YL « VVV-W1YS 



FIG. 11(A) 



START 



PEN SIZE 

DESIGNATING 

WNDCW 

CO-ORDINATE 

CONVERSION 



XL - HHH-W2XS 
YL • VVV-W2YS 



SPECIFY PEN SIZE 
BS=X 



END 



FIG. 1KB) 



START 



\ 




{ 



n ; BRUSH SAMPLE SQUARE SIZE 
m ; BRUSH SAMPLE NUMBER 
(X DIRECTION) 



END 



0 226 959 



FIG. 13 



START 







CF- 0 

CC ; PALLET COLOR ( Rc.Gc. Be) 
8S : PEN SIZE 

INT; ADDITIVE COLOR RATE 



SET X COUNTER 
XC=XL-BS 




EXECUTE 
FOR AS^ 
RCTURE 
ELEMEjN" 


: RANTING 
JGLE 








INCREMENT YC 



YC-YC + I 






YES 


INCREMENT XC 







X 

"COUNTER 
^OVERFLON 
«? 

Iyes 



0 226 959 



FIG. 14 



27 




(Xc.Yc) 



0 226 959 



FIG. 15 



START 






READ SOURCE 
GRAPHIC IMAGE 

PICTURE ELEMENT 
COLOR DATA 


\ 


t 



(Xc. Yc) 



CALCULATE TARGET 
GRAPHIC IMAGE 

PICTURE ELEMENT 
COLOR DATA 





r 


WRITE TARGET 

GRAPHIC IMAGE 

PICTURE ELEMENT 
COLOR DATA 




f 


END 



Rs (Xc. Yc ) 

Gs (Xc x Yc ) 
Bs (Xc . Yc) 



Rt (Xc .Yc) 

G T (Xc, Yc) 
Bt (Xc , Yc) 



FIG. 16 



29 



(0.0) 



(1024,0) 





' x(Rc,Gc,Bc) 




28^ 










x(Rs,Gs.Bs ) 


x(Rt,Gt.8t) 













(0. 1024) 



(0, 2048) 



BACKUP AREA 



SOURCE STORAGE 
AREA 



•30 



(1024,1024) 



(1024,2048) 



FIG. 17 



START 



SET X COUNTER 
XC=XL-BS 



SET Y COUNTER 



YC=YL-BS 




END 



FIG. 18 



START 



SET X COUNTER 



xox 



L-BS 



SET Y COUNTER 
YC = YL-BS 




EXECUTE 

CHALKING FOR 
ASNGLE 

RCTURE ELEMHVIT 



INCREMENT YC 




0 226 959 



FIG. 19 



START 




f 


SETXa 

xc=x 


DUNTER 

:l-bs 




f 


SET Y COUNTER 
YC=YL-BS 




EXECUTE 
BRUSHING FOR 
A SINGLE PICTURE 
ELEMENT 



INCREMENT YC 



Y 

"COUNTER 
OVERFLOW, 
9 



NO 





YES 


INCREMENT XC 







COUNTER* 
JOVE 



NO 



YES 



0 226 959 



FIG. 20 

START 

SET X COUNTER 
XC = XL-SS 



SET Y COUNTER 
YC°YL-8S 




EXECUTE 
COPYING FOR 
ASNGLE 
PICTURE ELEMENT 



INCREMENT YC 




INCREMENT XC 



NO 



YES 



END | 



FIG. 21 



START 



SET X COUNTER 
XC*XL- BS 



SET Y COUNTER 
YC»YL-BS 




EXECUTE 
MIXING FOR 
A SINGLE PICTURE 
ELEMENT 



INCREMENT YC 



'COUNTER 
'EF 

? 







INCREMENT XC 







miNTER\__NO 
.OVEF 

Iyes 



END 



FIG. 22 



START 
I 



SET X COUNTER 
XOXL-BS 










SET Y COUNTER 
YC ? YL-8S 










EXECUTE 
ERASING 
ASNGLE 
ELEMEN1 


FOR 

PICTURE 







INCREMENT YC 




\J 999 



FIG. 23 



START 




1 



MBX(PTC)=XL 
MBY(PTC) =YL 
PTC =PTC+ I 



MBXCPTO = XL 
MBYCPTQ = YL 



PTC : MASK POINT COUNTER 

MBX CfO , M8Y (n) : ARRAYS FOR 

STORING MASK 
POINTS 



DRAW A STRAIGHT LINE 
FROM A POINT (MBX (PTC-I), 
MBY(PTC-I) )TO A POINT 
(MBX (PTC) ,MBY(PTC] ) 



• y 

PTC=PTC-»- 1 




END 



FIG. 25 



START 







YC = 0 




FIG. 24(B) 







YES 


INCREMENT YC 








NO 



0 226 959 



FIG. 26(A) 




FIG. 26(B) 




FIG. 26(C) 




0 226 959 



FIG. 27 



START 






DISPLAY A 
REGISTERED 
MASK PATTERN 








YES 



ERASE DISPLAYED 
MASK PATTERN AND 
DISPLAY A NEW MASK 
PATTERN AFTER 
SCALING PROLESS 
IN X DIRECTION 




YES 



ERASE DISPLAYED 
MASK PATTERN AND 
DISPLAY A NEW MASK 
PATTERN AFTER 
SCALING PROCESS 
IN Y DIRECTION 



END 



0 226 959 



FIG. 28(A) 




FIG. 28(B) FIG.28(C) 




0 226 959 



FIG. 29 



START 



XCJX CO-ORDINATE COUNTER 
YC ; Y CO-ORDINATE COUNTER 



YC = 0 



XC = 0 



EXECUTE 
MIRRORING FOR 
A SINGLE RCTUREl 
ELEMENT 



INCREMENTXC 



"XC 
OVERFLOW 

? 



NO 





YES 


INCREMENT YC 








NO 



FIG. 31 



FIG. 30(A) 




FIG. 30(B) 




START 



XC 5 X CO-ORDINATE COUNTER 
Y C ; Y CO-ORDINATE COUNTER 



YOO 



XC=0 



JINT . 

(xcyowtthin 

YES 



NO 



EXECUTE 
COMPOSING FOR 
A SINGLE PICTURE 
ELEMENT 



INCREMENT XC 




NO 





YES 


INCREMENT Yc| 








NO 



FIG. 32(C) 




FIG. 32(D) 



FIG. 32(A) 




FIG.32(B) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 
IITfADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



